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COST OF INTITIAL DEVELOPMENT OF PLATO INSTRUCTION 
IN VETERimRY MDICINE 

by 

George M, Grimes, D,V,M,| M.M.S, 

Froin July 1970 through August 1974 the University of Illinoie Colleg© 
of Veterinary Medicine (CVM) inatituted the PL^TO System in its academic 
program. Procedures involved setting up an organization ^ establishing an 

adininistrative yystentj studying capabilities of the system, studyincf 
factors making a lesson suitable for programming ^ training progranraiers j and 

preparing CVM PLATO clasgrcom facilities* ApproKMately 317 instructional 

a b 
hours were developed, and more than 8^000 student-contact hours were spent 

using lessons* Soma student^attitude and lesson-effectiveness evaluations 

were carrifid out. Finally, plans were made for future use of PJ^TO at CVM, 

Lessons were developed in all major subject areas of veterinary medicine. 

An effort was made to salect lessons from subjects that were particularly 

suitable for computer-based instruction. More than 50 lessons were developed , 

including simulation of a bacteriology laborato:cy i ^ ^ ^ interactive prograums 

on veterinary diagnosis j a problem-^SDlving prograin in nutrition i gaming 

a 

An '■instructional hour*" is mn estirnate of the amount of Instructional 
material which can be covered in one hour by an average student who studies 
the material thoroughly. Or, it is the amount of classroom or laboratory 
instruction tima displaced by PLATO instruction. It is a figure that is 
sul^ject to change as more data is obtained with increased usage of lessons, 

b 

A "atudent-contact hour*' is the mount of tme in hours spent by one 
student using a PIATO lesson. It is recorded by the system as the student 
malces use of a lesson and is less subject to approximation than the "instruct 
tional hour." 
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progranis in public health, and a heart-sounds identification program using 
tha audio unit. An effort was made to select lessons from both basic and 
clinical science areas, from all four class Imrels, from both semesters, 
and from all months of the school year. The salaction permits relatively 
even distribution of use of terminals througliout the year and more efficient 
use of lessons. An effort was also made to involve as many subject-^matter 
specialists as possible in lesson development. During tha four-year period, 
24 instructors participated. 

The purpose of this paper is to report on eKpenditu^es, provide infor-- 
mat ion on the factors which influence cost of lesson development at CVM, 
indicate lengths of time required for lesson preparation, and consider factors 
of programmer efficiency- 

Summary of Expenditiires 

A total of 9483,266 was eKpended during the four'-year period. This 
sum includes all expenditures axcept computer usage and salaries of most 
instructors for and with whom lessons were developed. The computer usage 
was provided by the Sta^e of Illinois. instructors' salaries were generally 
not ineludea in the expenditures except those of released-time personnel 
or those of instructors paid by the PLATO Project, Sjveral instructors 
spent substantial time in developing PLATO lessons.^ however, most instructors 
did not spend more time developing PLATO lessons than preparing their 
conventional instruction. The instructor's time is further diluted as the 
lesson is used over a period of years with min^im time required for revising. 
The procedures used for preparation of CW P^TO lessond are designed to 
maKimize use of the instructor's knowledge, while minimi^^.ing his time in 
lesson preparation and progrmmning. 

6 
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The sources of funds for the CVM PLATO Project were as follows s 
DffiWj NIH Special Projects Grant^ $251|733 
DIIEW, NIH Capitation Grants 158,565 
Other Federal Funds 4,011 
State Funds 68,957 

TOTAL $483,266 



h sujiirnary of dietrjbution of funds is as follows; 

Lesson Pz'ograiraner Salaries 

Auf^.iovisual (PiV) Salaries (Photographers , 
Medical Illustrators J hV Maintenance j Etc^) 

Other Salaries (Coordinator! Administrative^ 
Secretarial, Statistician^ Nonproducti\re 
Personnel^^ Etc,) 



AV Supplies (Films, Microfiche^ Etc) 

General Supplies (Office j Books ^ Etc*) 

Travel (Primarily Consultants) 

Other (Conttnuni cation Lines ^ Copy Work, 
Site Controller, Etc.) 

Equipment (rerniinals* Audio, AV, Etc) 
Classroom Ranov^ation 



$124^670 
22,047 

84,804 
TOTAL SALARIES 
$ 4,033 
4,498 
4,360 

18,089 
TOTAL SUPPLIES 



$231 ,521 



30,980 
209^183 
11 ,582 



GRAND TOTAL $483,266 



8l 

Departntent of Health, Education, and Welfare, National Institutes of Health 

A few personnel did not stay with the project long enough to produce a 
lesson. 
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Table I lists detailed expendituras by les=qons developed j hours of 
instructiorial material in each lesson, programmers for each lesson and 
proportional part of lesson, salaries of personnel as specified for each 
lesson, expenses as assigned to each lesson, the grand total cost of each 
lesson, estimated cost for sach instructional hour, and estimated cost per 
stiident»CQntact hour if used by all students in the cm over a five-year 
period.* It should be emphasiged that figures shown in Table I are nob 
aatuat costiG for each lesson but are proportional to the instructional 
hours in oach lesson over the fouxr^year period. Individual lessons varied 
vjidely in time and cost to produce th^m. Table I does not include intitial 
Gosts of new equipment and classroom renovation in lesson development costs. 
The equipnient is recoverable and the renovated classroom can be used for 
individualized instruction other than PLATO. 

The total lesson development costs were ^262,501, or an average of 
S828.00 per hour of instruGtional material. At the present level of 86 
students per class, distributed over a five'-year period, this cost represents 
51.93 per students-contact hour. This calculation presumes that the lessons 
will be used at a maximum rate. These figures include the delivery of more 
than 8,00 0 student contact hours as well as the development costs. They 
represent the initial phases of PLATO lesson development for both the 
system as a whole and for the CTM. 

Table I indicates that the cost of developing an hour of instruction 
varied from $512,00 to $1,763* The principal factgrs affecting the variation 

*Total development cost {$262,501) ^ (86 .students per class ^ 5 years ^ 
317 hours of instruction) * development costs per student-contact hour for 
five years. g 
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in costs ware lev* ^ of development of the PLI\TO System, use of audiovisuals , 
prograniiner salary', length of timej required to develop a lesson, and prograiraner 
efficiency. 

Lessons listed in Table I are generally in chronological ordar in which 
the lessons were started. Lessons started in 1970 and some in 1971 were 
first progranmiad on PLATO 111, These lyssons ware later reprogranmed on 
PLATO IV, the preseut stage of the system, As the system developed, not 
only did the hardware and the availability of terminals improve substantially, 
but the TUTORS language was made more flexible and programming bacajne easier p 
As programiners became more experienced , they were able to provide better 
instructions to novice prograjTimers * The implementation of "coinmon" storage 
tables further improvad the manipulation of the system, 

A total of $26,080 was spent for audiovisual parsonnal, inclading a 
part'-time medical illustrator , and for audiovisual supplies* However, 
programs varied greatly in the amount of audiovisuals used with the greatest 
expenditures being for bacteriology, mycology, parasitology (arthropods) , 
poultry diseases, and ophthalmology , 

The 19 persons listed as lesson programmers included i one graduate 
vetarinarian, one experienced computer progranrmer, one mathematiCB major , 
eleven veterinary students, and five from other fields (English, bio-^chemistry | 
nuclear engineering * and business)* The graduate veterinarian was coordinator 
of the project and directly participated in development of 26 hours of 
instruction* The computer prograraner provided liaison with the systems 
programmers of the PLATO System, developed compleK routines which could be 



★TUTOR is the computer language used in the PLATO System. 

9 

o 

ERIC 



H- ( y C/S 

o a 

to O 

iy o i/> 


csi 




eg 
cvi 




m 
m 

OD 
O 
00 


q 


QO 


C%J 

W 


in 
tn 


0 
^; 

eg 






eg 


eg 


UJ O UJ o 

a u 0= X 


CP 

1 

=^ 






IS 

m 

00 


o 
m 
so 


If) 

to 


m 
w 


5. 


00 

in 




2 


so 


1 


GRAND 1 
TOTAL 


o 

o 
in 




a 

tn 

rn 


m 
m 


m 


CD 

s 

csT 

CSj 


fO 


m 

OD 


Si 
eg" 


in 
of 


rg 

OS 


cD 


fn 

CM 


in 

CD 




o 

H 




w 


iD 


<e 
rg 
in 




eg 
cvT 


00 


00 


OD 






m 

o 


OD 
CD 

eM 






LU 
X 


U> 
c\j 

£NJ 
4A 


o aj 


ego 




O 


m o 

CM 


CD 
6J 

eg 


CD 

eg 
<g 


a 
m 


(D OD 

o b 


£ 


^ eg 

at 


in 




(/) 

UJ 

UJ 

a. 


_J 

UJ 

:> 

S 


in 


ry 
cvi 


5 


CO 




m 

^- 


CD 
in 


w 

in : 


eg 
eg 


O 
Q 


in 


CD 


ro 

Hi 


m 


UJ 


UJ 


-Cr> 


00 




m 
m 




1 






00 

eg 


00 


in 


in 

00 


m 


in 




< > 


in 
cn 


CD 


in 
05 


m 
m 




ce 


in 
^ 


in 
cn 


00 




CD 




m 


CD 




o 


GO 
if) 


eg 




in 


CM 

a 


of 


m 
esj 
f^^ 
eg 


5- 


m 

s 






Q 
eft 

in 


@ 

€g^ 


1 


o 

ly 

0: 

3 


UJ 

s 


CD 

rn 


in 


CM 


eg 


CD 

d 

CP 


m 


rn 
tn^ 


CD 
ro^ 


in 

Hi 

in 


& 

% 
eg 


O 
O 


CD 

o 

CD 


eg 
Q 
00 


o 


9 3 

< > 


O 

CNJ 

in 


QD 
O 

<g 




GO 

eg 




o 
o 

C£L 

eg" 


O 
eg 
in 


O 
eg 

lO 


00 
O 

eg 






% 

CD 


eg 
ro 




si 

Ul It 


in ^ 
f^j ^ 
cvT 


w tn 


in Q% 


(C ^ o 
rs rg csj 


^ ^ 

^ O 

S3 m 


eg — 

^ CDf^lQ 

cfi in ^co^ 
fifm eg" 


00 


^ ^ K 
m ^ ^ 

S K) 


MS 


f- ^ £ 




eg CD g 
ih 6j S 
eg" 


in 

QO 


^ in 
eg ?1 CD 00 

^ U CM 0» 


X 

o 

if) 
if) 
Ui 


is 

og 
^ S 


< CD 

d U> 
Q C> 


< u 
o o 


oujffi u 


sn eg 

U- X 

15 CD 

O Q O 

£ Oice 

& 


in ^ 

"3 
^ tD 

ffi K K 

flu ^ 


^ in--^ 
a Q» Ol 0. 


in 

8 

a. 


^ ^ ^ 

K EE 2 
£L 


eg 

O O 
& & 


^ 0> in 

*4 *t W 

ooo 

£L CL a 


C0 CD 
O© 


eg 3^ 
cb d ^ 

Sep 

a. 


CD 

8 


O M c^ 1^ 

d ^ d 
So So 

Ci 

Q» 0, 


£ S 


in 


M 


w 






yi 
eg 




in 














UJ 
< 

U 
UJ 

v> 
q: 
O 

UJ 


O 

1 


p 
< 

u 
m 
u 

o 

Ui 

U 

? 


3 

O 

m 
m 

y 

i 

«^ 


i > 

gSi 

UJ m> 
It ®o 

t 3<UJ 
= yUBQ 


C/5 
O 
O 

Si 

< UJ 

Is 

teP i 
»- oe u 

SSg 
Sis 


can 

si 

ii 

log 


'a 
lb 
&_ 
a 


i 

>- 

1. 

= S 
>£ 


'z 
o 

o 

Q 
U 

3 

U 


3 

O 
H 

5 
1 


UJ 

a_ 

>= 

8 

3 


m 

UJ 

G 

Q 
a. 

UJ in 
1= UJ 

O ^ 

UJ Ui 

31 


S 

UJ 

N 
u. 
Q 
>- 

3 

o 

s 


ii 

=1 


U 
X 

g 

CD 

o 

i 

P 

la 


S 
£ 

s 


m 

_i = 

^ in 

iS 

5 < 

t I 
^ O 
O CD 

















7 




8 




9 



C/3 



m 
eg 



c 

ii 

i 

a 

d 

O 

c 

Q 

tn 
J 



0 



ff^ eg 

CO ® 



g 

I 



to 
op 



z 

CD 

E 

a 

(K 
f 

Z 
Q 

a 



»2 



























j 


O 

E 


















u 




a; 










S 












fe 
y 


1 

















!3 



o 
E 



U 
02 



as 



u 

H 
LU 

I 

HI 



Q 
CO 



1 



S 

o 

S 



3 



5 

C 

u 



I 

Uj 

1 

u» 

f 
I 

8 I 



i 1 



0 

I 



0 
02 



3 



M S 



M 



01 



f/i 



g 



s ^ 

g to 



h ^ ^ 



o» 

s 

I 



US 
0> 

g 

E 
E 

5 



M 



g 

a 
I 



s § 



9 ^ 



E o ffl 

E £ 

S 5 If 

fi 1 a a 

I 



a 



8 s 



-I' 



a 



1 

f/) IS 

J s 

■ o 

g s 



i € 



't « "2 

g ^ 



4/) 



% M E 
% § X 

'sf jy 



|2 



i lA 

6 ^ 

IS 

* o 

» *' 

•J -e 

1 8 

I i 

i i 

S S 

U </) 

« 4» 

« 2 

a J 

.a e 



-I* 

s 



6 



3 



,9 



I I 
1 i 



4. 



3 



E 

I) 



y 

I 
Uj 



d 

f 

I 

a 
E 
s 
a 



3 

0 

§ 



9 



.r 

5. 
S 



I 



i 

a 
I 



13 



10 



m&d %y lesson pr ograireners , and trained and assisted lesson prograiraners in 
tte use of the TUTOR language. The matheniatics major spent approKiniately 
liaLf time monitoring the PWTO classrooin and half time progrMffning lesson 
jnaterial, 

^he v^eterlnary student programmers dev^eloped lessons in conjunction with 
their classes mdi in cooperation with their instructors. They wWm able to 
approach las sons from a student's point of vlewj which proved to be an asset 
in attracting student use. The seleGtion of moat of the vaterlna^y student 
yrc^gr^iwne^rs hegan in tbt^ siajmer before they entered veterinary school, 
:RecQrds ©£ all new veterinary students were reviewed and those with eduea- 
tionali mathematical, or computer background were contacted. Within budget 
Itmitatloni ^ t^o&B desiring part-tiine employment were offered a Job on an 
JoiMly i5asis* After a trial period, usually one semester, they were employed 
as quarter-time teaching assistants for the school year and full-time in the 
summer. One of the students had two and one-half years' teaching experience, 
Another had a B.S, in Electrical Engineering and an M,S, in Biomedical 
Ingineering. Ml had B,S, or M,S. degrees. 

The seven non-^veterinary related prograiraners were selected for their 
eKpiriajice in vorking with VUiTO, for their eKpertise in a related field, 
or far their ability to proofread lessons for nrrora in English usage* 

The Salaries of individuals varied acaording to ttelr rating j length 
of einployrtnent, and date of OTplo^ent, in general the cost of an hour of 
instruction was higher for more highly paid prograiraners. 
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1 1 

Estimated Time for Lesson Development 

^he estimated time for lesson developnent is frequently rec^ested by 
prospective users of the PL&TO System, A precise answer camiQt be gLvmn 
because of the many factors bearing on the decision i however, Tables 13 and 
III provide some information* 

Table II lists each progr^mer employed by the CTM PLATO Project for the 
foi^-year periods Ihe ait^unt of time for whioh tiie individual was paid was 
reduced to hours and divided by the number of houri of instruction produced* 
Several prograimers worked more, others lessj* than tlie hours for whlah they 
vrere paid* Even thoee who maintained a record of their time frecjuantly 
devoted non-work time to productive thinking or claasroom activltiea which 
contributed to their prograni, 

Another factor affecting the nmnber of hours recjuired to produce one 
hour of instruction is the length of time leasons have been in existence. 
Moat of the early lessons have continued being developed and revised. 
The capacity of the system to receive feedback infowiation from users and 
Its facility for rapid editing provide a unique cap^ility of oontinuous 
editing not possible in printed pi^lications , Lessons which have been in 
existence and undergoing revision for a long time are correspondingly inors 
expensive than newer lessons. 

Several employees were responsible to^c other activities such as class* 
room monitor on evenings or weekends, or project atoinistration. Two individuali 
were computer progrwmers and assisted others in lesson production. 

*Theae individuals wre frequently highly produotive during the hours 
they worked. ^ 
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For the four-year period, veterinary itudent pr^rananeirs averaged about 
90 hours to produce one hour of instruction; however , since the times used 
by two progrMffners ware axtremely high^ the median of 65 liours is considered 
more valid statistically • The a^^arage and raedian for all programers were 
182 and 77.5 reepectively. As the project continued, yie average nraiber 
of hours required to produce one instructional hour decreased. The average 
time for programmers presently employed is 62 houra. Unproductive progr^iers 
are no longer employed. Pi^ra 1 shows tbe average production tisia of all 
prograirttEiers who have worked with the project* 

FrogrMimer Efficiency 

The fact that some prograffmers take more time to produae an hour of 
instruction than others does not necessarily ^ply that the individual is 
less efficient. Lessons vary greatly in their quality and cOTplexity. Pro- 
grammer involvement varies greatly. Some programmers design and progrm 
the lesson almost entirely on their own, while cUiers have iosson tdeslgns 
laid out and then need only do the programing, 'me use of audiovisuals 
(slides, audio, and manuals) or graphics requires more time per lesson. 
Some prograimers select topica whlGh assure extensive student use. Although 
they produce less InstrUGtienal hours than other prograwmera student-- 
contact hours for their lessons we highi 

Some other factors influencing prograDTOier effioiancy arai 

a) Stage of develo^E^nt of the systra. 

b) Length of employment. 

a) Use o£ audiOTisualg, The praduction testing, revision i 
etc. , raquirad siore t^e on thm part of the prograimar , 

d) Other activities* iot© prog^ammars perfomed ottier funetioMj 
. such as olasiroom aonil^r in addition to lasaon prog^aroinf. 



14 



1400- 
1340- 



340' 

seo-- 
300— 
O 280^ 

a mo- 
o 

U MO- 

i 

w 200 - 



UJ 



ISO- 



1^0- 



140- 



lao- 



tn 100— 

1 



i 

m 

i 



60- 



□ 



STILL EMPLOYED 



NO LONGER EMPLOYED 



MONTH/ YEAR IS INDICATED FOR 
START AND END OF EMPLOYMENT. 



53 



59 



64 



€5 



as 







48 


40-- 


31 


///^ 
//// 
//// 
// // 

* f ^ * 


ao- 








^/// 




A 


I 



IF/71 



1/73 



ic/rc 




PROGRAMMERS 



M 



18 



er|c 



Figu:£^ 1. Averaf a Production ^ima and period of a^loj^ment of prograwtfaears 



15 



e) Ability of the progrMmer, Some were more proficient than 
others * 

f) Application of the prograMner. Some put in more time than 
others, although paid for the same amount of time* 

g) Knowledge of subject matter. Programmers with less knowledge 
about veterinary medicine were lees efficient in lesson pro- 
gr^nming than others. 

ApproKimately 1 5% of lesson prograOTners employed were deemed inefficient 

and their contracts were not renewed* One of these was a total loss with no 

lessons produced* 

Cost of Lesson Prograroning After Ifears' ^perience 

Table III indioates the prograiOTing cost and time to produce an hour 
of instrUGtion after the project had been underway for two years. Four 
programmers were selected who were employed during the period and whose hours 
of instruction produced were reasonably distinct. Programmers I and G were 
ei^loyed before Septeniber 1972. The other two programmers i progrOTffner H and 
programmer K, were employed after Bepten^er 1972, Within IS months programmer K 
learned to manipulate the system rapidly and approached programmers I and Q 
in efficienoy. 

Expectad Future Cost of the CW PLATO Project 

Several factors indicate that lesson development can be performed TOre 
quickly, efficientlyi and inexpensively in the futurSp lesson development 
costs should be reduoed sharply provided the economy is statie. There is 
an inaraased ease in programming a lesioni progranmers are becoming more 
expert iti leiaon programfilng and lesson design programing* There Lm 

an improved knowledge In recognising lessoiiS that are suitable for programing* 
Administration of the projaet has Jjnproved with e^arienca, 

19 
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TABLE III 

S^dPia COST OF LESSON PROGRAMMING DURING 
SECOND TWO niARS OF PROJECT 





Prograitmier I 


Prograjmer e 


Prograimier M 


Prograamier X 


PrograiTOing time 
period between 
9/72 and 9/74 


9/72--5/74 
21 moe. 


9/72-9/74 
24 mos. 


6/73-9/74 
15 mos. 


9/73-9/74 
12 If^S, 


Hours of instruction 
produced since 
. 9/1/72 

) 


34 


29 


18 


17 


Amount paid 


$5*008.70 


$7,601.53 


$5,824,58 


13,006.48 


Coat per hour of 
inatruGtlon 


$ 147.31 


$ 262,12 


$ 323,59 


$ 176.85 


Hours worked^ 


1,244 


1 ,776 


1,472 


908 


Time required to 
produce one hour 
of instruotion 


3^ 


61 


82 


53% 



Average prc^gramming cost per hour of instruction .5227,47 

Average time required to produce one hour of instruction * * , 58% 

^Before September 1972 prograitmier I virote lesions at the rate of $213.72 
and required 63 hours to program one hour of instruction^ 

^Before SeptenODer 1972 prograraner 3 wote lessons at the rate of $271.04 
and required 72 hours to program one hour of instruction. 

Based on time for which paid. 
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The eKpected cost of the CVM PLATO Project in the future is dependent 
on a number of factors; some of these are: 

a) Amourit of student usage. At present, students use teminals 
approKimately 15% of tAe time that teiminale are available 
to theni* Presently I 21 teminals are available for about 
6jO0O hours per month and used about 900 hours per month 

by students* As the nmrtoer of lessen hours increases ^ the 
availability of computer space increases, and more class time 
is made available for student usei the number of student- 
contact hours will then increase. As student-contact hours 
increase, operational costs will rOTiain ^out the samej and 
the cost per student will decrease, 

b) Amoiint of continued lesson development. Continued lesson 
development will require continued emplo^ant of lesson 
prograimners and thus increased cost, 

c) Nianber of locations of student tenainals requiring monitoring 
personnel* At present there is one monitored classroom. In 
1975--76 a second monitored slassrocm will be added , increasing 

costs, 

d) Number of operating terminals, A larger nuntoer of terminals 
increases the cost, but improves opportunity for student use. 

e) toount of classroom monitoring desired. Increased monitoring 
increases the cost, 

f ) NunUDer of hours classroom will be open. Cost per terminal- 
contact hour decreases with longer hours of terminal availability* 

g) Amount of repair required for terminals and facilities* 

h) Employment of personnel to provide released time for instructors. 
This factor increases costs but improves quality and use of 
lessons, 

t) Amount of statistical evaluation performed, 
j) NiMnber of types of audiovisuals needed* 
k) Supplement ^y materials needed, 

1) Items Included in cost calculatioiii , e.g,, office telephone 

service, computer costs, office supplies, heating, electricity, 
etc. Some of these costs may be charged to general operating 

a5£pensee and not to PLATO delivery costs. 
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Sunmiary 

The cost of initial development of PLATO instruction during a four* 
year period wslb $483,260* Of this amount i $220,765 ware for equipment or 
renovaticii. The cost of lesson development for the entire four years aver- 
aged about $828.00 per hour of instruction. If 83 students uied the lessons 
In each class at a maximum rate, over a five-^year period the cost per itudent- 
contact hour averages $1*93. With experianca this figure should be reduoed 
substantially. 

The median time required for an individual to program an hour of instruc-' 
tion for the entire four years was approximately 77 hours; however, under 
certain conditions a progranimer may require as little as 36*^ hours* Prograinmar 
efficiency is based on a niamber of faotors such as the guality and complexity 
of the lessons, eKperience of the progrananeri and his knowledge of the subject 
matter. 

The Unlvarsity of Illinois College of Veterinary Medicine has been 
devetopm&ntat* The expense of cont nuing the project at this college or 
initialising a similar project at another collage should be much less as a 
result of this eKpariance. 
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